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ABSTRACT 


This  thesis  analyzes  the  implications  of  academic  setback  for  retention,  perfor¬ 
mance,  and  training  costs  using  extracts  from  the  Enlisted  Training  and  Tracking 
(TRAINTRACK)  File,  Special  Cohort  Accession  and  Continuer  (DSCAC)  Files, 
and  Navy  Enlisted  Classification  Tracking  (NECTRACK)  File.  The  proportion  of 
A-schooI  graduates  who  were  and  were  not  setback  was  compared  for  different  men¬ 
tal  categories  and  high  school  diploma  status.  Academic  setbacks  were  promoted  at 
lower  rates  than  non-setbacks  for  all  mental  categories.  The  implication  for  training 
costs  are  ambiguous  because  the  cost  data  and  the  setback  data  are  incompatible. 
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I.  INTRODUCTION 


Initial  skill  training  for  enlisted  personnel  at  Navy  A-schools  must  foster  pro¬ 
fessional  development  and  contribute  directly  to  overall  mission  accomplishment. 
This  task  has  become  more  complex  in  the  wake  of  budgetary  cuts  and  reduced 
manpower  levels.  In  an  effort  to  maintain  the  quality  of  A-school  instruction  under 
these  conditions,  the  Navy  has  been  studying  all  aspects  of  the  A-school  environ¬ 
ment. 

Navy  A-schools  provide  initial  rate  training  to  enlisted  personnel.  The  major¬ 
ity  of  students  reporting  for  A-school  instruction  do  so  immediately  upon  completion 
of  recruit  training.  Others  report  from  various  Navy  commands  as  a  result  of  enlist¬ 
ment  guarantees,  rating  conversions,  or  recommendations  from  commanding  officers. 
Selection  criteria  and  length  of  instruction  (pipeline  lengths)  vary  between  A-schools 
(See  Appendix  A).  Successful  completion  of  A-school  training  is  designed  to  lead 
to  attainment  of  a  gener^'  service  rating,  to  satisfy  mandatory  Training  Manual 
(TRAM.AN)  requirements  for  advancement  to  petty  officer  third  class,  and  to  pro¬ 
vide  graduates  the  necessary  skill  and  knowledge  required  to  function  effectively  in 
future  assignments.  (Ref.  l:p.  A-6] 

Chief  of  Naval  Technical  Training  (CNTECIITR.A)  Instruction  1540. 39C,  .At¬ 
trition  and  Setback  Policy,  Monitoring,  and  Reporting  Procedures,  states  that; 

Student  attritions  and  setbacks  are  expensive  actions  which  reduce  our  capa¬ 
bility  to  provide  enough  well-trained  and  higlily-motivated  sailors  to  the  Fleet. 
Administrative  and  management  proccdure.s  must  be  carefully  designed,  judi¬ 
ciously  applied,  and  conscientiously  nionitor<  (l  to  ensure  that  each  setback  or 
attrite  is  fully  justified.  [Ref.  ■2;p.  1] 


A-school  setbacks  are  classified  as  either  non-academic  or  academic.  Non- 
academic  setbacks  result  when  training  is  interrupted  for  reasons  such  as  emergency 
leave  or  hospitalization.  Academic  setbacks  are  given  to  students  who  are  failing  to 
achieve  course  learning  objectives  on  schedule,  provided  that  other  forms  of  reme¬ 
diation  such  as  extra  study,  tutoring,  or  coun.seling  have  been  exhausted,  and  that 
it  is  clear  that  an  academic  setback  is  in  the  best  interest  of  both  the  student  and 
the  Navy.  [Ref.  3:p.  1] 

The  decision  to  allow  a  setback  is  made  by  an  A-school’s  commanding  officer 
baised  on  the  recommendation  of  an  Academic  Review  Board  (ARB).  The  ARB 
consists  of  officer  and  enlisted  instructional  and  supervisory  personnel,  classroom 
and  learning  center  instructors,  and  education  or  training  specialists.  [Ref.  4:p.  7]. 
The  ARB  reviews  a  student’s  performance  and  interviews  him  to  assess  his  chances 
of  completing  the  training.  If  the  board  decides  that  sufficient  ability  and  motivation 
for  graduation  exist,  it  can  recommend  that  the  student  be  setback  (normally  not 
to  exceed  25  percent  of  the  total  course  length)  rather  than  expelled. 

Setback  rates  for  each  A-school  pipeline  are  monitored  at  all  command  levels 
in  order  to  detect  significant  changes  and  to  take  corrective  action  if  necessary.  Set¬ 
back  rate  reference  points,  known  as  Upper  .Management  Limits  (UML),  have  been 
established  for  each  A-school  by  the  Chief  of  .Naval  Education  and  Training  (CNET). 
These  limits  are  not  desired  levels  of  setback,  but  rather  a  means  of  recognizing  sig¬ 
nificant  trends.  A  12-month  moving  average  of  actual  setback  rates  is  compared  to 
the  UML,  and  if  actual  rates  vary  from  the  UML  by  more  than  the  pre- determined 
tolerances  given  in  Table  1.1,  the  UML  is  reviewed  for  possible  adjustment. 

For  the  purpose  of  this  thesis,  student  (juality  is  defined  by  different  combi¬ 
nations  of  two  criteria,  mental  category  ami  t-ducatioiial  attainment.  Mental  cate¬ 
gory  is  determined  by  an  individual's  score  on  the  .Armed  Forces  Qualification  Test 


TABLE  1.1:  ACADEMIC  SETBACK  UPPER  MANAGEMENT  LIM¬ 
ITS  (UML) 


~ 

U.ML 

r.MI.  v.s.  12  Motith  Actual 
Tolerance  Limit 

1  to  5  percent 

±2  percent 

6  to  10  percent 

±3  pcicetit 

11  to  15  percent 

± !  |»erccnt 

16  percent  or  more 

±5  percent 

Source:  CNTECHTRA  Instruction  1540. 39C 


(AFQT).  The  AFQT  is  an  '‘aplitude  roinposih".  ,  liicli  consists  of  the  Word  Knowl¬ 
edge,  Paragraph  Coniprclicnsion.  Ariiliinctir  Hca'-oiiing.  and  Numerical  Operations 
subtests  from  the  Armed  Services  N'ocational  Aptitude  Battery. 

The  Navy  targets  mental  category  1,  II  and  lll.\  individuals  in  its  recruiting 
effort.  However,  because  the  military  is  an  all- volunteer  force,  it  must  compete 
with  other  employers  for  recruits.  In  ordri  to  mec-t  recruitment  goals,  the  Navy 
has  to  strike  a  balance  between  lower  cdtication  and  aptitude  standards  for  basic 
enlistment,  and  separate  (and  often  higher)  standards  for  assignment  to  A-schools. 
[Ref.  5:p.  118] 

Studies  have  shown  that  high  school  graduation,  while  not  necessarily  a  mea¬ 
sure  of  intellectual  capacity  or  aptitude,  is  usefni  in  prc'dirting  an  individual's  adapt¬ 
ability  to  military  life;  non-high  scliool  graduates  are  ticarlv  twice  as  likely  not  to 
complete  their  first  three  years  of  enlistment  [Ucf.  o'.p.  25]  Educational  attain¬ 
ment  falls  into  one  of  two  ealegoiies:  indixidu.iK  wlm  received  regular  high  school 


TABLE  1.2:  MINIMUM  APTITUDE  STANDARDS  FOR  ENLIST¬ 
MENT 


Education  Level 

AFQT  Percentile 

High  school  diploma  graduatr' 

17 

GED  recipietU 

31 

Non-high  school  graduate 

3S 

Source:  [Eitelberg,  Mark  J.,  Manpower  for  Military  Occupations] 

diplomas  (HSDC)  and  those  who  did  not  ( \().\1  ISDCI ).  The  first  group  includes 
recipients  of  General  Educ  itional  Dcvelopnu-nt  (GliDl  (crtificates  of  high  school 
equivalency.  The  latter  group  includes  non-graduates  and  recipients  of  certificates 
of  attendance  or  completion  of  occuiralional  progiams.  The  .N’avy  uses  educational 
attainment,  weighted  combinations  of  .XSX'.AH  su!)t('sis  (“aptitude  composites”), 
and  mental  categories  in  screening  recruits  for  enlist  nx’iit  and  assigning  them  to  A- 
schools.  Minimum  ant  it  ude  st  andards  for  enlist  nient  in  t  he  Navy  are  shown  in  Table 
1.2,  while  “aptitude  composite"  standards  for  .X-sdiooK  examined  in  this  study  are 
contained  in  Appendix  A. 

This  thesis  examines  the  retention,  performance,  and  training  costs  tissoci- 
ated  with  Navy  A-school  graduates  who  were  giv<'n  academic  setbacks  during  their 
.A-school  training.  Retention  is  nieasntx'd  by  length  of  set  vice  after  .A-school  train¬ 
ing,  and  performance  by  rate  of  advancement  in  raidv.  Training  costs  are  analyzed 
using  cost  data  maintained  by  the  Naval  Edmaiion  and  IVaining  Program  Manage¬ 
ment  Support  Activity  (NETP.MS.X).  The  study  is  leslricted  to  individuals  from 
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the  following  ratings:  AE,  BT,  GSM,  IIT,  MS,  RM,  and  YN  ratings.  These  ratings 
have  diverse  “aptidude  composite”  selection  criteria  and  were  recommended  by  staff 
members  from  the  office  of  the  Chief  of  Naval  Technical  Training  (CNTT)  to  facil¬ 
itate  a  comparison  of  students  with  different  abilities  (mecisured  by  quality  type). 
[Ref.  6:p.  2] 

Academic  setbacks  have  been  used  in  Navy  schools  to  decrease  attrition  and 
enhance  student  academic  progress  by  giving  individuals  more  time  to  complete 
their  trai'  ..ig.  While  the  additional  time  required  for  student  setbacks  does  not 
guarantee  graduation,  it  does  result  in  increased  training  costs  for  the  Navy.  One 
question  is  whether  any  resulting  performance  and  retention  improvements  outweigh 
the  costs.  Other  research  questions  are  whether  retention  and  promotion  rates  differ 
for  A-school  graduates  who  were  academically  setback,  and  what  costs  associated 
with  A-school  training  are  affected  by  academic  setbacks. 


II.  LITERATURE  REVIEW 

In  order  to  analyze  the  effectiveness  or  benefit  of  a  policy,  one  must  first 
determine  how  that  policy’s  success  is  to  be  measured,  and  then  select  an  evalu¬ 
ation  technique  that  can  accurately  relate  this  measurement  to  the  costs  required 
to  achieve  it.  For  the  policy  of  academic  setback,  this  means  first  determining  the 
differences  in  success  between  A-school  graduates  who  were  setback  and  those  who 
were  not,  and  then  evaluating  how  much  these  differences  cost  the  Navy. 

A.  MEASURING  SUCCESS 

Research  on  measuring  academic  performance  and  linking  this  performance  to 
adult  achievement  has  historically  concentrated  on  graduates  of  civilian  institutions. 
Dr.  Robert  D.  Bretz,  Jr.  of  Cornell  University  employed  meta-analytic  techniques 
to  review  50  previously  published  studies  (conducted  between  1917  and  1983)  on 
the  relationship  between  college  grade  point  average  (GPA)  and  various  measures  of 
adult  achievement  such  as  salary,  tenure,  and  job  satisfaction.  Bretz  concluded  that 
no  GPA-occupational  success  relationship  e.xisted.  (Ref.  7:p.  1]  He  offered  three 
principal  explanations  for  his  findings: 

•  course  content  and  difficulty  vary  significantly  between  schools,  as  well  as 
within  them 

•  extracurricular  activities,  while  often  contributing  to  a  lower  GPA,  can  spawn 
desirable  attributes  such  as  leadership,  motivation,  or  a  strong  work  ethic 

•  GPA  is  too  subject-  and  situation-specific  and  not  a  measure  of  general  intel¬ 
ligence  [Ref.  7:pp.  19-20]. 
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Bretz’s  findings  agreed  with  those  of  Alice  M.  Nelson  of  the  U.S.  Civil  Service 
Commission.  In  her  report,  Nelson  concluded; 

a  simple  and  direct  application  of  grade  point  average,  class  standing,  or  sim¬ 
ilar  academic  achievement  measures  has  little  merit  in  valid  and  job-related 
selection  systems.  [Ref.  S:p.  25] 

Citing  the  importance  of  demographic  and  behavioral  indicators,  «ls  well  as  the 
complexity  of  the  academic  achievement-job  success  relationship  itself,  she  stressed 
that  grades  should  only  be  viewed  as  one  “clue,  requiring  support  from  other  clues.” 
[Ref.  8:p.  26] 

Although  education  is  related  to  training,  the  two  are  not  the  same.  In  a  1985 
study  on  military  training.  Jesse  Orlansky  of  the  Institute  for  Defense  Analyses  ana¬ 
lyzed  the  differences  between  training  and  education.  These  differences,  summarized 
in  Figure  2.1  related  more  to  policy  and  management  issues  than  to  subject  matter, 
methods  of  instruction,  or  the  nature  of  students.  [Ref.  9:p.  3] 

For  measuring  .A-school  performance,  the  closest  proxy  to  GPA  in  the  Navy  is 
graduation  status  (including  academic  setback),  while  occupational  success  in  the 
Navy  is  best  measured  by  retention  and  performance.  Using  only  these  measures 
can  produce  biased  results  because  retention  and  performance  are  also  affected  by 
mental  category  and  educational  attainment.  However,  while  not  all-inclusive,  these 
measures  are  accessible  and  important  to  the  Navy.  Other  inputs  such  as  evaluation 
reports  have  limited  accessibility  and.  like  GP.A,  are  too  subjective  and  do  not 
indicate  general  intelligence. 

Martha  E.  Sheills  of  the  Center  for  Naval  .Analy.sis  (CN.A)  examined  the  re¬ 
lationship  between  .A-school  attrition  and  Navy  attrition  by  comparing  retention 
and  promotion  rates  for  individuals  who  passed  and  did  not  pass  A-school  training, 
while  allowing  for  differences  in  mental  category  and  high  school  diploma  status. 


Characteristic 

Training 

Education 

Type  of  Institution 

Military  Services/ 
Industry 

Schools/Colleges 

Types  of  Courses 

Linked  lo  jobs 

Linked  to  careers 

Course  Length 

Days  to  years 

Semester 

School  Day 

Full  day 

Partial  day 

Pay  and  Allowances 

Students  reimbursed 

Not  provided 

Costs  of  Instruction 

Institution  pays 

Students  pay 

Finding  a  Job  After 
a  Course 

Institution  assigns 
graduates  to  job 

No  obligation 

Benefits: 

Completing  a  course 

Institution  and 
student  benefit 

Only  student 
benefits 

Saving  student  time 

School  benefits; 
job  benefits 
(earlier  product  ivity) 

No  benefit  to 
school  (potential 
loss  if  school 
reimbursed  on  basis 
of  student-days  in 
residence) 

Increasing  student 
achievement  at  school 

No  benefit  to 
school  except  for 
prestige;  job  benefits 
if  school  achievenu'iit 
transfers 

No  benefit  to 
school  except 
prestige;  student  benefits 
if  better  job  follows 

Figure  2.1:  Distinctions  Between  Ti'aining  and  Education 
Source:  [Orlansky,  Jesse,  The  Cost-EfTectiveness  of  Military  Training] 


S 


The  CNA  study  concluded  that  high  school  graduates  in  the  higher  mental 
categories  were  more  likely  to  complete  technical  A-schools  and  earn  promotions, 
and  that  regardless  of  mental  category  or  A-school  success,  those  without  high  school 
degrees  had  higher  attrition  and  lower  promotion  rates.  It  also  found  that  a  strong 
connection  between  academic  failure  in  A-school  and  Navy  attrition  could  not  be 
supported.  [Ref.6:p.  37] 

All  of  the  aforementioned  studies  strongly  suggest  that  demographic  and  be¬ 
havioral  variables  such  as  educational  attainment,  mental  category,  and  motivation, 
have  greater  impact  on  retention  and  promotion  outcomes  than  academic  perfor¬ 
mance,  and  that  A-school  performance  (including  academic  setback)  is  not  a  valid 
or  reliable  predictor  of  future  retention  and  performance  outcomes. 

B,  THE  COST  OF  SUCCESS 

Only  after  understanding  the  academic  setback-occupational  success  relation¬ 
ship  can  the  relationship  between  a-school  training  costs  and  academic  setback  be 
explored.  The  information  necessary  to  examine  A-school  training  costs  is  located  in 
the  Naval  Education  Training  Command  (N.AVEDTR.ACOM)  Recruit/Specialized 
Skill  Cost  to  Train  records.  ‘‘Cost  to  train”  repre.scnts  the  NAVEDTRACOM  costs 
and  Navy  military  pay  and  allowances  incurred  for  training  during  a  fiscal  year  in 
which  both  course  production  data  and  resource  (obligation)  data  are  obtained.  It 
is  the  actual  calculated  costs  for  resources  which  are  directly  or  indirectly  chargeable 
to  NAVEDTRACOM  training.  [Ref.  lOiEncl.  2]  Figure  2.2  identifies  items  included 
in  NA\TDTR.ACOM  cost  to  train. 

For  education,  the  relationship  between  success  and  cost  has  traditionally 
been  examined  using  either  cost-benefit  analysis  (CB.-\)  or  cost-effectiveness  analy¬ 
sis  (CEA).  The  use  of  CB,^  models  by  training  managers  is  rare.  Among  the  most 


<) 


TYPE  OF  COST 

DESCRIPTION 

Instructional  Costs 

Costs  of  conducting  training 
including  pay  and  allowances 
for  instructional  personnel, 
contract  instructors,  and 
training  equipment  maintenance. 

Overhead  Costs 

Indirect  costs  of  conducting  training 
including  supplies,  materials,  TAD, 
curriculum  developnieut,  and  ADP. 

Direct  Student  Costs 

Pay  and  allowances  of  the 
sttidents  in  training. 

Base  Support  Costs 

Costs  of  the  support  provided 
to  the  training  activity  by  a 
N.A\'EDTR.\COM  activity  such  as 
comptroller,  security  police,  and  MWR. 

Functional  Command 
Support  Costs 

The  costs  for  the  managerial  support 
provided  to  the  training  activity 
by  the  functional  command. 

Figure  2.1:  NAVEDTRACOM  Cost  to  Train  Items 
Source:  [Analysis  and  Costing  Division,  NETPMSA] 
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frequent  reasons  given  for  not  using  CBA  are  the  difficulty  in  quantifying  the  ben¬ 
efits  of  training,  and  the  inability  to  separate  training’s  role  from  other  factors  in 
performance  improvement.  [Ref.  ll:p.  CO]  The  use  of  CEA  models  requires  the 
development  of  comprehensive  cost  element  structures.  Such  a  cost  element  struc¬ 
ture  has  been  developed  for  military  training  by  Mark  Knapp  and  Jesse  Orlansky 
of  the  Institute  for  Defense  Analyses.  It  is  a  highly  detailed  breakdown  of  the  func¬ 
tional  elements  of  cost  that  constitute  life-cycle  costs  of  military  training  programs, 
courses,  and  devices.  [Ref.  12:pp.  3,8] 

Unfortunately,  neither  of  these  two  evaluative  techniques  can  be  used  in  this 
thesis.  CBA  cannot  be  used  because  evidence  of  the  influence  of  academic  setback 
on  performance  and  retention  must  exist  before  attempts  to  quantify  it  can  be 
undertaken.  In  order  to  use  CE.A  or  Knapp  and  Orlansky’s  cost  element  structure, 
data  must  be  accessible,  detailed,  and  cover  a  sufficient  period  of  time.  The  majority 
of  accessible  A-schooI  cost  data  are  too  highly  aggregated  and  inconsistent  to  be 
suitable  for  CE.‘\. 

Standardized  cost  data  for  .4-schooi  training  conducted  prior  to  fiscal  1986 
are  not  available.  Beginning  in  fiscal  1990,  a  change  in  costing  methodology  was 
implemented  whereby  training  costs  originate  at  the  course  level,  rather  than  being 
prorated  from  the  department  level  to  the  course  level.  [Ref.  I0:p.  1]  Therefore,  in¬ 
cluding  post-fiscal  1985  cost  data  in  an  analysis  of  acadi'mic  setbacks  which  occurred 
between  fiscal  1981  and  1981  is  extremely  comi)lex. 

Even  with  limited  cost  data,  the  relationship  between  A-school  training  costs 
and  academic  setback  can  be  probed.  This  is  accomi)lished  by  identifying  cost 
elements  of  A-school  training  which  are  affected  by  academic  setback,  and  then 
exploring  the  magnitude  of  this  effect  Iw  comparing  changes  in  setback  rates  to 
changes  in  training  costs  for  .\avy  .-\-schook. 


III.  METHODOLOGY 


The  success  of  A-school  graduates  is  measured  by  identifying  students  to  be 
used  in  the  sample,  establishing  their  graduation  and  academic  setback  status,  and 
tracking  their  retention  and  performance  outcomes  over  the  years  following  A-school 
graduation.  The  information  required  to  accomplish  these  steps  are  the  individual’s 
training  performance  at  A-school,  and  his  subsequent  promotion  and  retention  his¬ 
tory.  This  information  was  obtained  by  merging  (using  social  security  numbers) 
selected  A-school  training  performance  data  from  the  Enlisted  Training  and  Track¬ 
ing  (TR.AINTR.ACK)  File,  selected  promotion  and  retention  data  from  the  .Special 
Cohort  Accession  and  Continuer  (D.SC.AC)  Files,  and  selected  biographical  data 
from  the  Navy  Enlisted  Classification  Tracking  (NECTRACK)  File.  The  resulting 
data  set  contained  information  on  an  indivkiuars  A-school  training  performance, 
demographics,  and  promotions,  as  well  as  the  date  he  left  the  service.  After  the 
data  sets  were  merged,  social  security  numbers  were  deleted  to  ensure  compliance 
with  Privacy  Act  requirements. 

TRAINTRACK  data,  obtained  from  the  Navy  Personnel  Research  and  De¬ 
velopment  Center,  document  every  enlisted  person’s  training  history.  The  TRAIN- 
TRACK  data  set  contains  records  of  training  conducted  at  schools  that  report  to  the 
Navy  Integrated  Resources  and  .Administration  System  (NITRAS).  Navy  A-schools 
submit  training  reports  to  NITR.AS.  [Ref.  13:p.  1]  DSC.AC  data  are  maintained 
by  the  Defense  Manpower  Data  Center.  This  file  is  a  career-tracking  file  which 
follow’s  active  duty  enlisted  personnel  from  tlie  time  they  enter  the  Navy  to  the 
time  they  separate.  NECTR.ACK  data  ar(‘  derived  from  the  Enlisted  Master  File 
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TABLE  3.1:  SELECTED  RATING  PIPELINES  AND  CORRESPOND- 
ING  CDPS  FOR  FISCAL  1980-1984,  Source:  [NETPMSA] 


Rating 

Course  Data  Processing  Codes 

AE 

6218  62.3.5  6515 

BT 

6260  6186  6189 

GSM 

606B  600Y  620P  6513  654-1 

6545  8562  8563  8564  8565 

HT 

6106  6119  6120  6339  6517 

MS 

6125 

RM 

6144  6350  6352  6380  6381 

'I'N 

0057 

at  the  Navy  Military  Personnel  Command  and  contain  demographic  information  on 
enlisted  personnel. 

The  first  step  in  building  the  final  data  set  was  to  select  from  TRAINTRACK 
individuals  who  received  instruction  bctw('cn  I'iscal  lOSl  and  19S4  in  any  course 
associated  with  one  of  seven  A-scliools.  Table  3.1  identifies  the  seven  applicable 
A-schools  and  associated  courses  (CDPs)  for  their  specific  training  pipelines.  This 
five  year  window  provided  for  a  sufficient  time  for  tracking  careers.  This  step  was 
accomplished  using  the  TR.Al.NTR ACK  elements  CDP  and  FY  to  define  pipeline 
and  time  period  constraints,  respectively.  Figure  3.1  e.xplains  which  data  elements 
from  TR.AINTR.ACK  were  used. 

CNET  and  C.NTECIITRA  determine  the  seciucnce  of  courses  taken  by  stu¬ 
dents  going  to  A-schools  upon  completion  of  initial  military  training.  As  detailed 
in  Appendix  B,  all  but  seven  of  the  2S  course>  contained  in  Table  3.2  have  been 
deactivated  (changed.  consolidat('d.  or  eliminated).  B('cause  of  the  fluid  nature  of 
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L.lcniciil 


Description 


l•^• 

.As-of  date  fiscal  year.  A  2-position  numeric  field 
indicating  the  fiscal  year  an  individual  was 
undergoing  training. 

CDP 

('oiirse  data  juocessing  code.  A  unique  4-position 
alplianumeric  code  that  identifies  each  course  at 
a  particular  training  activity. 

.SD.\'l' 

Start  date.  The  .5-digit  Julian  date  on  which 
the  student  actually  began  class. 

i  AD.AT 

•Actual  graduation  date.  The  5-digit  Julian  date 
of  the  individuars  actual  graduation. 

ASI/l 

Acadf'inic  setbacks.  .A  2-position  number  indicating  the 
total  number  of  academic  setbacks  the  student  incuiicd 
ill  this  parlienlai'  (omse  (CDP). 

SAC 

1 

Student  action  code.  .A  .3-character  code  indicating 
the  final  S.AC  that  occurred  for  the  student  prior  to 
transfer  or  discharge. 

Figure  3.1:  Essential  Elements  in  TRAINTRACK  Data  Set 
Source:  [Nakada,  Milezersky,  Wolfgang,  and  Wax,  “Enlisted  Training 
Tracking  File  (TRAINTRACK)”] 
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TABLE  3.2:  AFQT  CATEGORIES 


AFQT 

AFQT 

Level  of 

Category 

Percentile  Score 

Trainability 

I 

93-99 

Well  above  average 

II 

65-92 

Above  average 

IIIA 

50-64 

Average 

IIIB 

31-49 

Average 

IV 

10-30 

Below  Average 

V 

1-9 

Well  below  average 

Source:  [Eitelberg,  Mark  J.  Manpower  for  Military  Occupations] 


A-scliool  courses.  Fiscal  19S0  CDPs  were  included  in  defining  rating  pipelines  to 
ensure  all  relevant  instruction  was  included  in  the  final  data  set. 

The  DSC.AC  data  elements  used  to  track  post-graduation  retention  and  pro¬ 
motion  status,  as  well  as  NECTR.ACK  elements  used  to  identify  an  individual's 
mental  category  and  educational  attainment,  are  listed  in  Figure  3.2.  AFQT  per¬ 
centiles  were  grouped,  and  these  groupings  designated  mental  categories  1,  II,  III.^, 
IIIB.  IV,  or  V.  These  grc  ipings  appear  in  Table  3.2. 

Using  release  5.18  of  the  Statistical  Analysis  System  (SAS)  software,  programs 
were  developed  which  accomplished  the  following  for  each  of  the  seven  ratings: 

•  identified  .A-school  graduates 

•  grouped  .-\-scliool  graduates  by  mental  category  and  educational  attainment 

•  diflerentialed  between  those  graduates  who  were  setback  and  those  who  were 
not 
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DSCAC 


Description 


PYGD 

Paygrade.  A  2-position  numeric  code  that 
indicates  an  individual’s  paygrade. 

DCPG 

Date  of  current  paygrade.  A 

4-positioii  numeric  field  (YYMM). 

DI.E 

Date  of  latest  enlistment  (YYM.M). 

DOS 

Date  of  separation  (YYMM). 

NECTRACK 

Description 

AFQT 

AFQT  .score.  .A  2-position  number  which 
indicatrs  the  score  attained  on  the  AFQT  by  the 
service  incmlrer. 

CERT 

Education  certification.  .A  unique  1-position 
character  that  indicates  the  highest 
educational  certificate  attained. 

Figure  3.2:  Essentia]  Elements  of  DSCAC  and  NECTRACK  Data  Sets 

Source:  [Nakada,  Milezersky,  Wolfgang,  and  Wax,  “Enlisted  Training 

Tracking  File  (TRAINTRACK)] 


•  determined  retention  status  at  30-,  45-,  and  60-months  of  service 


•  determined  promotion  status  at  30-,  45-,  and  60-months  of  service 

Finall\.  separate  retention  and  promotion  rates  were  calculated  for  all  graduates, 
gradual es  who  were  sell)ark.  and  graduates  who  were  not  setback.  These  propor¬ 
tions  were  then  tested  for  statistical  significance  at  the  .05  level  by  using  a  test  for 
comparing  two  relative  frefinencies  pi  and  where 

-  =  I  fh  -  Pi  I 

wlieie  ui  and  Uj  aie  the  sample  si7,e  of  ea( h  group  and  c  is  the  standard  normal 
distribution.  [Hef.  loipj).  373.  5ni-5n_’j 


IV.  DATA  ANALYSIS 


A.  THE  SAMPLE 

The  sample  is  comprised  of  27,010  individuals  who  graduated  from  one  of  seven 
A-school  training  pipelines  between  Fiscal  19S1  and  19S4,  and  who  commenced  this 
training  within  two  years  of  entering  the  Navy.  This  criteria  limits  the  sample  to 
new  recruits  who  have  completed  their  basic  military  training  (including  any  travel 
or  minor  delays),  and  eliminates  the  inclusion  of  fleet  returnees  to  A-schools. 

The  sample  breaks  down  into  quality  groups  shown  in  Table  4.1  Mental  cat¬ 
egories  I  and  II  were  combined  in  order  to  gel  large  enough  sample  sizes,  while 
categories  I\'  and  V  were  excluded  under  the  NO.NHSDG  heading  because  mini¬ 
mum  aptitude  standards  for  enlistment  (Table  1.2)  resulted  in  sample  sizes  that 
were  too  small.  The  distribution  of  A-schooI  graduates  contained  in  Table  4.1  re¬ 
flects  the  Navy’s  history  of  recruiting  individuals  from  mental  categories  I,  II,  and 
III.A.  Eighty-seven  percent  (21. 90S  IISDGs  and  1(>09  NONHSDGs)  of  the  sample 
fell  under  these  mental  categories. 

Table  4.2  shows  the  distribution  of  .A-school  graduates  who  received  academic 
setbacks  (ASBs)  by  quality  type.  The  aggregate  data  in  the  last  column  show  that 
7.2  percent  of  all  A-school  graduates  in  the  sample  experienced  academic  setback 
during  their  training.  Holding  educational  attainment  constant,  the  proportion  of 
setbacks  increased  for  lower  mental  categories.  Ilokling  mental  category  constant, 
setback  proportions  by  educational  attainment  were  not  statistically  different  at  the 
.05  level. 


IS 


TABLE  4.1:  DISTRIBUTION  AND  PERCENTAGE  OF  A-SCHOOL 
GRADUATES  (FISCAL  1981-1984) 


lUasc 


Sines  tooB 

MeaCeJ 

CeU*or7 

A£ 

BT 

CSM 

HT 

MS 

RM 

YN 

ToUl 

B3DC 

i/n 

142 

96 

15 

97 

60 

60 

3 

02 

6 

06 

54 

68 

4 

0  4 

403 

69 

mA 

142 

14  8 

106 

143 

27 

110 

7 

06 

n 

1.1 

114 

U.l 

7 

09 

414 

7  1 

niB 

119 

H7 

215 

22.3 

13 

15  6 

10 

09 

75 

19 

211 

12.5 

12 

19 

656 

84 

rv  t  V 

34 

227 

130 

202 

3 

11  1 

3 

15 

35 

4  7 

96 

12.5 

1 

04 

306 

107 

SnbtelAl 

437 

13  5 

*696 

166 

93 

78 

23 

06 

127 

24 

4T7 

105 

24 

08 

1777 

72 

NONBSDG 

I/D 

25 

12.1 

7 

75 

0 

00 

3 

13 

0 

OO 

14 

U7 

0 

00 

49 

60 

nu 

n 

12  8 

3 

14 

0 

00 

7 

4.9 

4 

18 

21 

19.8 

1 

IS 

S3 

68 

ms 

12 

203 

4 

AM 

0 

00 

4 

4  8 

8 

33 

37 

25.5 

2 

63 

104 

Snbuul 

54 

13  « 

14 

45 

0 

0.0 

14 

39 

12 

1.9 

72 

205 

3 

1.5 

169 

75 

T<iUl 

4«1 

13  S 

610 

14  7 

9S 

78 

37 

05 

139 

14 

549 

112 

27 

09 

1945 

72 

Source:  Derived  from  TRAINTRACK,  DSCAC,  and  NECTRACK  Data 
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TABLE  4.2:  DISTRIBUTION  AND  PERCENTAGE  OF  A-SCHOOL 
GRADUATES  WITH  ACADEMIC  SETBACKS  (FISCAL  1981-1984) 


EAtcaMB 

UmUI 

rtHfnry 

AS 

BT 

G3U 

HT 

MS 

RM 

YN 

Tsui 

BSDG 

i/n 

i4ai 

40.S 

1497 

360 

631 

•97 

1347 

322 

691 

163 

1130 

23  1 

1036 

339 

9215 

304 

IDA 

M9 

26.4 

742 

17.9 

366 

20.6 

1169 

r  9 

997 

17.1 

946 

193 

797 

264 

9955 

21.7 

OXB 

CM 

176 

966 

23.2 

62 

69 

1103 

264 

2664 

•37 

1690 

346 

616 

26.0 

7636 

290 

IV/ V 

160 

4.1 

•46 

16.5 

27 

Z3 

206 

49 

756 

U.0 

792 

ICO 

232 

90 

2660 

106 

SuUaul 

66.9 

3649 

92.6 

liw 

996 

3626 

91  4 

6200 

69.1 

4637 

92  9 

2933 

93  6 

24768 

91.7 

NONBSOC 

1/D 

306 

67 

93 

Z2 

4 

o.a 

130 

31 

170 

29 

110 

Z3 

97 

3  1 

910 

3  0 

DU 

133 

3.7 

U4 

3.0 

1 

01 

144 

34 

226 

3.9 

106 

12 

66 

XI 

799 

30 

ttTB 

19 

1.7 

C9 

X2 

1 

01 

64 

Z1 

342 

4.1 

130 

26 

99 

1.2 

•43 

13 

Muul 

396 

11  1 

306 

7.4 

6 

0.6 

263 

6.6 

637 

109 

346 

7.1 

201 

•4 

2262 

93 

Taul 

3626 

100 

4166 

100 

1192 

100 

4163 

100 

6637 

100 

4963 

100 

3134 

100 

27010 

100 

Source:  Derived  from  TRAINTRACK,  DSC  AC,  and  NECTRACK  Data 
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Examining  individual  ratings,  absolute  setback  percentages  were  highest  among 
the  more  technical  AE,  BT,  GSM,  and  RM  ratings.  In  the  less  technical  HT,  MS 
and  YN  ratings,  the  proportion  of  ASRs  among  graduates  was  relatively  low.  This 
difference  is  probably  due  to  the  more  difficult  curricula  of  the  technical  A-schools. 

These  findings  support  claims  that  aptitude  test  results  are  better  than  edu¬ 
cational  attainment  as  an  indicator  of  trainability  and  academic  success.  They  also 
highlight  the  importance  of  controlling  for  these  variables  in  subsequent  analyses. 

B.  RETENTION  AND  PROMOTION 

Having  constructed  the  sample  and  categorized  A-school  performance  in  terms 
of  academic  setback,  post-graduation  success  was  measured  using  retention  and 
promotion  rates.  By  reporting  the  proportion  of  .*\-school  graduates  who  completed 
their  initial  obligated  service  or  first-term  <'n!istmriit,  retention  rates  serve  as  a 
measure  of  reenlistmcnt.  Recnlistmcnt  is  a  desirable  outcome  from  the  Navy’s  point 
of  view  because  it  keeps  experienced  personnel  in  tlie  service  and  avoids  incurring 
the  costs  of  recruiting  and  training  replacements. 

Table  -1.3  presents  the  retention  rates  for  all  .-\-.schoo]  graduates  in  the  sam¬ 
ple,  arranged  by  student  qualit}’.  Overall  retention  rales  are  further  broken  down  by 
graduates  who  were  setback  ( ASBs)  and  graduates  who  were  not  setback  (NONASBs) 
Time  periods  were  based  on  an  individual's  date  of  entry  into  the  service.  Thirty 
months  was  used  because  it  is  less  than  the  time  required  for  the  initial  obligation 
of  service  for  everyone  in  the  sample.  Forty-five  months  is  less  than  the  end  of  ser¬ 
vice  for  those  with  four-year  obligations,  while  (iO  months  is  greater  than  the  initial 
enlistment  obligation  of  all  individuals  in  the  sainph'.  except  for  six-year  obligators. 
Only  the  GS.M  rating  had  a  high  number  of  six-yi  av  obligators  and,  not  surprisingly, 
had  the  highest  GO-month  survival  rate. 


Due  to  the  low  number  of  total  academic  setbacks  in  certain  ratings  (GSM, 
HT,  and  YN),  and  the  low  number  of  NONUSDG  ASBs  in  all  ratings,  aggregate 
retention  rates  were  examined.  Table  4.3  shows  that  with  the  exception  of  mental 
category  I/II  HSDGs,  there  was  no  statistically  significant  difference  between  overall 
ASB  and  NONASB  30-month  retention  rates.  Controlling  for  mental  category,  30- 
month  retention  rates  for  all  graduates  were  significantly  lower  for  NONHSDGs. 

Controlling  for  mental  category,  30-month  retention  rates  for  all  graduates 
were  significantly  lower  for  NONHSDGs.  Controlling  for  educational  attainment, 
ASBs  in  most  mental  categories  had  lower  retention  rales  than  NONASBs  at  45 
and  60  months. 

These  findings  support  the  claim  that  non-high  school  graduates  fail  to  com¬ 
plete  their  initial  service  obligations  at  higher  rates  than  high  school  graduates. 
They  also  suggest  that  mental  category,  an  indicator  of  .A-school  performance  (as 
measured  by  academic  setback),  may  also  indicate  higher  percentages  of  ASB  losses 
after  the  first  three  years  of  service. 

Promotion,  the  second  measurement  of  post -graduation  success,  was  analyzed 
in  a  similar  fashion.  Promotion  is  an  important  measure  because  it  represents  the 
culmination  of  numerous  accomplishments  .such  as  longevity,  experience,  technical 
proficiency,  and  good  conduct.  In  addition  to  improving  an  individual’s  status 
within  the  Navy’s  hierarchy,  promotion  also  provides  the  individual  with  monetary 
incentives  in  the  form  of  increased  pay  and  allowances. 

Table  4.4  shows  the  percentage  of  A-school  graduates  in  the  sample  who  ad¬ 
vanced  to  or  beyond  paygrades  E-4  and  E-5  by  various  periods  of  time.  As  in  the 
case  of  retention  rates,  time  periods  were  based  on  an  individual’s  date  of  entry  into 
the  service.  For  each  paygrade-time  period  combination,  overall  promotion  rates  are 


TABLE  4.3:  RETENTION  RATES  FOR  ALL  RATINGS  (PERCENT) 


Satantaon  Period 

SO  Months 

46  Months 

60  Months 

Education 

Mental 

Catagory 

All 

Grads 

ASBs 

Non- 

ASBs 

AD 

Grads 

ASBs 

Non- 

ASBs 

AD 

Grads 

ASBs 

Non- 

ASBs 

RSOC 

i/n 

82.1 

76.9 

82.4* 

66.8 

60.8 

66.1* 

26.9 

20.8 

27  J!* 

niA 

81.9 

83.1 

81.6 

64.5 

61.4 

64.6 

21.8 

19.6 

22.0 

ITTR 

80.2 

79.4 

80.3 

62.4 

68.9 

62.8* 

23.0 

16.9 

23  4* 

IV/ V 

83.6 

82.3 

83.7 

67.8 

66.6 

68.0 

24.4 

10.1 

24.9* 

Subtotal 

81.6 

80.2 

81.7 

64.7 

61.2 

66.0 

24.1 

19.8 

24.5 

NONHSDG 

I/D 

63 

75.5 

62.4 

43.2 

66.1 

42.6 

15.4 

16.3 

154 

HU 

60.6 

698 

69.9 

41.3 

60.9 

40.6 

13.9 

17.0 

13.7 

nm 

66.3 

74.6 

66.3 

44.2 

68.2 

42.5* 

160 

14.9 

16.1 

Subtotal 

63.1 

8.7 

1.2 

42.8 

9.6 

Z1 

16.1 

8.0 

0.6 

Total 

80.1 

796 

80.2 

62.9 

60,7 

63  1* 

23  4 

194 

23.7* 

■  Indirfllc'*  statistical  significance  at  tlic  .05  level 
Source:  Derived  from  TRAINTRACK,  DSCAC,  and  NECTRACK  Data 


broken  down  by  ASBs  and  NONASBs.  Aggregate  data  are  presented  in  Table  4.4. 
Promotion  rates  by  individual  rating  and  quality  type  arc  given  in  Appendix  D. 

For  NONASBS,  promotion  rates  for  IISDGs  were  higher  than  NONHSDGs  for 
E-4  and  45  months,  E-5  and  45  montlis.  Promotion  to  E-4  by  30  months  was  the 
exception.  ASB  promotion  rates  exhibited  the  same  pattern,  with  the  exception 
of  promotion  to  E-5  by  45  months.  The  results  also  show  that  among  HSDGs  in 
the  sample,  NONASBs  had  higher  promotion  rates  than  ASBs,  regardless  of  mental 
category. 

These  findings  clearly  show  that  high  school  degree  status  is  an  indicator  of 
the  likelihood  for  promotion.  Since  receiving  an  academic  setback  in  A-school  does 
not  figure  in  the  selection  process  for  promotion,  these  findings  also  suggest  that  the 
variables  which  contribute  to  academic  setback  might  also  influence  the  likelihood 
of  promotion. 

Summarizing  the  relationship  between  academic  setback  and  success,  A-school 
graduates  in  lower  mental  categories  were  more  likely  to  l)e  setback  prior  to  complet¬ 
ing  their  A-school  training.  Between  A-school  graduation  and  30  months  of  service, 
NONHSDGs  tended  to  separate  from  the  .Navy  at  higher  rates  than  HSDGs,  regard¬ 
less  of  setback  status  or  mental  category.  After  30  months  of  service,  high  school 
degree  status  made  no  sigtiificant  difference  in  retention  rales,  but  retention  rates  for 
ASBs  lagged  those  of  NONASBs,  except  for  category  IIIA  individuals.  Educational 
attainment  and  mental  category  were  significant  in  tiearly  all  promotion  rates,  and 
among  HSDGs,  ASB  promotion  rates  lagged  those  of  .N'ON.NSBs  for  every  promotion 
and  time  period. 
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TABLE  4.4:  PROMOTION  RATES  FOR  ALL  RATINGS  (PERCENT) 
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Indicalc'?  statistical  significance  at  the  .05  level  for  ASBs  versus  Non-ASBs  in 

each  mental  category 

Source:  Derived  from  TRAINTRACK,  DSCAC,  and  NECTRACK  Data 


C.  A-SCHOOL  TRAINING  COSTS 


The  final  section  of  this  chapter  explores  the  relationship  between  A-school 
training  costs  and  academic  setback.  As  stated  earlier,  it  is  desirable  for  an  or¬ 
ganization  to  be  able  to  measure  a  program  or  jrolicy,  both  in  terms  of  success, 
and  the  cost  of  achieving  success.  Keeping  in  mind  that  ASBs  appeared  to  have 
lower  retention  rates  after  30  months  in  all  mental  categories  except  IlIA  and  that 
NONASBs  had  higher  promotion  rates  than  .ASBs  regardless  of  mental  categories, 
an  interesting  question  is  whether  .ASBs  make  an  imi)ortant  contribution  to  higher 
training  costs. 

Ideally,  an  analysis  of  the  training  cost-academic  setback  relationship  would 
examine  concurrent  cost  and  setback  data  for  the  entire  training  pipelines  of  each 
rating.  Unfortunately,  one  department  of  .\’1M  P.MS.A  keeps  track  of  costs  and  an¬ 
other  keeps  track  of  setbacks.  Bccavise  the  two  groiii)s  use  different  courses  (CDPs) 
to  define  rating  pipelines,  the  data  are  incompatible  for  every  rating  except  MS  and 
YN.  .As  a  result,  “ratings”  in  this  section  of  the  analysis  are  comprised  of  only  those 
curriculum  courses  where  both  cost  data  and  setback  data  are  available. 

A-school  training  cost  data  are  maintained  by  the  Analysis  and  Costing  Di¬ 
vision  of  NETPMS.A.  This  division  uses  financial  data  from  the  Navy  accounting 
system  and  student  data  from  NITR.AS  to  generate  cost  data.  The  data  include 
full,  fixed,  and  variable  costs  which  reflect  the  dir('(  t  aiul  indirect  costs  of  instruc¬ 
tors,  support  personnel,  curriculum  materials  and  development,  supplies,  contracts, 
and  a  pro  rata  share  of  base  operations  snpimrt  costs.  The  data  also  include  Navy 
military  pay  and  allowances  for  instructors,  support  pcnsonnel,  and  students.  [Ref. 
13:p.  1]  Annual  costs  per  graduate  arc  broken  down  by  rating  and  course.  The  data 
represent  are  the  average  costs,  not  the  marginal  or  o])portunity  costs  associated 
with  A-school  training. 


TABLE  4.5:  AVERAGE  ANNUAL  INCREASE  (DECREASE)  FOR 
COST-SETBACK  ITEMS  (PERCENT,  FISCAL  1986-1990) 


Rat  ing 


AE 

riT 

GSM* 

IIT 

MS 

RM 

YN 

TOTAL 

Fixed  Cost  per 
Graduate 

2.1 

2.1 

(0.8) 

(9.4) 

6.3 

(0.1) 

1.3 

0.2 

Variable  Cost  per 
Graduate 

9.1 

19.8 

5.1 

(3.8) 

23.7 

9.2 

8.2 

10.2 

Number  of 
Graduates 

(16.2) 

(16.9) 

31.9 

2.0 

12.3 

(2.8) 

1.1 

2.1 

Graduate  to 
Attrite  Ratio 

(8.3) 

(2.0) 

32.3 

(3.1) 

(7.5) 

13.1 

17.4 

6.0 

Setback  Rate 

5.2 

(Ij^.l) 

5.0^ 

(0.3) 

0.8 

(1.5) 

3.7 

(2.2) 

‘Fiscal  19S7-1990 
^Fiscal  19SS-1990 


Changes  in  annual  costs  j)er  graduate  were  calculated  for  each  rating  and 
compared  to  changes  in  setback  rates  over  the  same  period.  .Appendix  E  contains 
selected  cost  and  setback  data  by  rating  for  Fiscal  1986-1990.  Table  4.5  summarizes 
these  data  by  showing  average  annual  changes  for  ('ach  item  of  interest  over  the  five- 
year  period.  Once  again,  it  is  important  to  sIk’.^s  that  these  figures  do  not  represent 
the  entire  training  pipelines  for  all  ratings. 

Table  4.5  shows  that  fixed  cost  per  graduate  remained  relatively  unchanged 
during  the  five-year  period,  while  varial)Ie  cost  jx-r  gratluate  increased  by  over  ten 
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percent  each  year.  Possible  explanations  for  the  cost  increcises  include  inflation, 
changes  in  accounting  and  costing  methods,  new  pay  and  allowance  levels,  curricu¬ 
lum  length  and  content,  and  the  use  of  simulalors  and  other  training  devices.  Un¬ 
fortunately,  the  available  cost  data  do  not  allow  one  to  itemize  these  cost  increases. 
Thus  it  is  impossible  to  determine  what  portion,  if  any,  of  these  cost  increases  are 
the  result  of  A-school  setback  policy. 

While  not  included  in  the  available  cost  data,  op)jortunily  costs  and  marginal 
costs  warrant  discussion.  If  an  individual  is  setback  and  eventually  graduates,  var¬ 
ious  opportunity  costs  may  be  incurred.  Oiu'  stub  cost  is  the  delay  in  receiving  a 
trained  individual  (.A-school  graduate)  by  an  opcnational  unit.  This  delay  can  result 
in  involuntary  extensions  for  individuals  awaiting  replacement,  or  a  particular  job 
(billet)  going  unfilled  for  an  extended  period  of  time.  Another  potential  opportu¬ 
nity  cost  results  from  restrictions  placed  on  new  <‘niolhi)ents  imposed  because  of  an 
influx  of  ASBs  into  later  classes. 

Since  the  number  of  .ASRs  tends  to  be  small  and  the  marginal  costs  associated 
with  remedial  work  may  be  of  greater  concern.  Hut  tlu'se  marginal  costs  associated 
with  academic  setback  arc  minimal  because  most  of  the  additional  resources  required 
to  implement  academic  setback  have  already  been  «'xpended  during  the  exhaustion 
of  remedial  efforts.  Once  a  setback  has  been  awarded  and  a  student  placed  in  a  later 
class,  no  significant  real  costs  are  incurred. 

Theoreticall)’,  an  effective  setback  policy  should  increase  both  the  number  of 
graduates  and  the  graduatc-to-att rite  ration  and  r<'dnce  the  high  costs  associated 
with  attrition  by  identifying  and  awarding  setbacks  to  individuals  who  ultimately 
graduate  and  recommending  attrition  early  enough  in  case's  where  students  will  not 
graduate. 


Table  4.5  also  shows  increases  in  both  the  total  number  of  graduates  and  the 
total  graduate- to-attrite  ratio  over  the  five-\'car  period.  The  total  setback  rate  on  the 
other  hand  decreased  of  over  two  percent  each  3'ear.  Increased  student  enrollment, 
more  selective  screening  of  entrants,  less  difficult  (or  more  comprehensible)  curricula, 
or  the  degree  of  leniency  by  ARBs  and  commanding  ofheers  could  have  influenced 
the  larger  number  of  graduates,  as  well  as  the  improved  graduate- to-attrite  ratio. 
Any  combination  of  these  scenarios  might  also  have*  contributed  to  the  lower  setback 
rates. 

Graduate-to-attrite  ratio  was  included  in  Tal)le  1.5  because  attrition  is  much 
more  costlj'  to  the  Navy  than  setback.  Of  course,  a  student  who  was  setback  and 
subsequently  attrited  represents  the  highest  (ost  to  the  Navv,  since  both  setback 
costs  are  incurred  and  no  graduate  is  produced. 


V.  CONCLUSIONS  AND 
RECOMMENDATIONS 


The  purpose  of  this  thesis  was  to  analyze  the  implications  of  A-school  academic 
setbacks  for  retention,  performance  and  training  costs.  This  was  accomplished  by 
developing  a  data  set  that  merged  portions  of  the  Enlisted  Training  and  Tracking 
(TRAINTRACK)  File,  the  Special  Cohort  Accession  and  Continuer  (DSCAC)  Files, 
and  the  Navy  Enlisted  Classification  Tracking  (NIXTHACK)  File.  In  addition,  a 
literature  review  was  undertaken  to  provide  a  summary  of  available  information  on 
factors  that  influence  academic  performance,  the  validity  of  academic  performance 
as  an  indicator  of  occupational  success,  the  relationship  between  A-school  and  Navy 
attrition,  and  various  cost  evaluation  techni(|nes.  The  data  set  was  analyzed  by 
identifying  A-school  graduates  who  were  .sethac  k.  and  comparing  their  retention  and 
promotion  rates  to  graduates  who  were  not  s<-tl)iu  l<.  I'inally,  using  cost  data  and 
setback  data  provided  by  the  Naval  Education  and  Training  Program  Management 
Support  Activity  (NETPMS.-\),  the  tyi)cs  and  magnitude  of  costs  associated  with 
academic  setback  were  explored. 

A.  CONCLUSIONS 

The  following  specific  conclusions  are  drawn  Irom  the  results  of  the  study: 

1.  In  the  aggregate,  mental  category  was  a  good  indicator  of  academic  setback 
for  A-school  graduates.  However,  the  nnmher  of  .X-school  graduates  who  were 
setback  represented  a  small  pro|)ortion  (7.2  percent )  of  all  A-school  graduates. 


2.  The  proportion  of  ASBs  who  were  retained  in  30-nionths  was  not  significantly 
different  than  the  proportion  of  non-ASBs.  It  was  significant  in  45-  and  60- 
month  retention  rates  for  HSDGs  in  mental  categories  I/II  and  IIIB.  However, 
this  was  not  the  case  for  IIIA  HSDGs  who  represent  21.7  percent  of  all  grad¬ 
uates  in  the  sample  and  are  highly  sought  after  by  Navy  recruiters. 

3.  Regardless  of  mental  catcgor\-  or  time  ix  riod.  promotion  rates  for  HSDGs  who 
were  setback  were  less  than  promotion  rates  for  those  who  were  not  setback. 
The  differences  in  these  promotion  ral<‘s  ranged  from  5.4  percent  (mental  cat¬ 
egory  IV/V,  E-5  by  45  montlis)  to  10.1  percent  (mental  category  I/II,  E-56 
by  60  months). 

4.  Based  on  the  small  proportion  of  A-school  gradnales  who  were  setback,  and  the 
overall  absence  of  any  statistically  significant  disparity  between  the  retention 
and  promotion  of  setbacks  and  non-setbacks,  the  Academic  Review  Boards 
appear  to  identify  people  who  benefit  from  academic  setbacks. 

5.  Unfortunately,  one  department  of  NETPMS.A  keeps  track  of  costs  and  another 
keeps  track  of  setbacks.  Because  the  two  groups  use  different  courses  (CDPs) 
to  define  rating  pipelines,  the  data  are  incompatible  for  every  rating  except 
MS  and  YN. 

B.  RECOMMENDATIONS 

The  following  recommendation''  are  iniM-d  upon  tiie  results  of  this  thesis: 

1.  Utilize  procedures  similar  to  those'  in  this  iliesis  to  expand  this  analysis  to 
include  more  ratings,  longer  time  periods,  and  other  demographic  characteris¬ 
tics  that  arc  highly  correlated  to  .-\S\  .\H  test  scores  (i.e.,  racial/ethnic  group 
and  gender). 


2.  Continue  to  evaluate  prerecjuisite  skill  training  for  Navy  A-schools  that  have 
high  setback  rates.  Ensure  that  feedback  from  .Academic  Review  Boards  are 
included  in  this  evaluation. 

3.  Evaluate  the  completeness  and  usefulness  of  cost  data  entered  into  NETPMSA 
data  bases.  Ensure  that  the  courses  (CDPs)  that  are  used  to  define  ratings 
are  those  promulgated  by  CNET  and  arc  being  used  consistently  by  different 
divisions  within  NETPMS.A. 

4.  Develop  a  cost  element  structure  (CF.S)  for  .Navy  .A-school  training  that  in¬ 
cludes  provisions  for  setback  and  attrition,  and  use  this  CES  to  guide  the  type 
of  the  cost  data  collected  on  A-'-chool  training. 


APPENDIX  A 

Rating  and  A-School  Description 


R.vn.xc 

scnooi. 

OCCUP.ATIONAE 

FIELD 

APTITUDE  COMPOSITE 
QUALIFICATIONS^ 

LENGTH 

(DAYS)2 

AE  -  .Aviation 
Elort  rician's 

Mato 

Aviation 

Maintenance 

\\'capons 

AR  +  2MK  +  GS 
=  196 

152 

BJ  -  Boilfi 
Tr'cluiiriaii 

Marine 

Engineei  ill" 

MK  +  AS 
=  96 

92  (4YO) 
150  (6YO) 

eSM  -  Cas 

Tnibinr 

.Systems 

Terlinician 

Mt'clianical 

Marine 

Engineering 

AR  +  MK  +  El 
+GS  =  204 

153  (4YO) 
178  (6YO) 

IIT  -  Mull 

Tr(  hniriaii 

Ship 

Maintenance 

VE  +  MC  +  AS 
=  158 

60 

MS  -  MeS' 

Ma  iiageineiil 

S]'>e(  ialisl 

Lngist  ics 

\T  +  AR 
=  89 

47 

H.M  -  Rnrlioman 

Communicat  ions 

\'E  +  MK  +  CS 
=  147 

89 

-  Vi'oman 

•Administ  rat  ion 

VE  +  NO  +  CS 
=  160 

49 

'  A  |)i  ii  ii'li'  ( 'onipn^ii  c’>  ;ii  p  comhiiiai  ioii'  of  individual  ASA'AB  subtests.  The  ten  subtests 
ar'  (Jnirral  Srii'iicf'  (CIS).  Ariilniif’i  ic  Uca.soiiiii"  (AR),  AA’ork  Knowledge  (WK),  Paragraph  Com- 
prolif'itsioii  (PC'),  Xmiiorical  Operations  (NO),  Coding  Speed  (CO),  Auto  and  Sliop  Information 
(AS).  Maih  Knowledge  (MK),  Mechanical  Comprehension  (MC),  and  Electronics  Information  (El). 
Verbal  Conipo-iic  (\’E)  is  a  combination  of  the  WK  and  PC  subtests. 

■  n'O  -  four-year  obligator;  6A'0  -  six-year  obligator 
SoMirru  U.S.  Nfrvy  Enlisted  Transfrr  Manual 


APPENDIX  B 

Status  of  A-school  CDPs  (Fiscal  1980-1984) 


RATING 

CDP 

COl’RSE 

TYPE' 

DEACTI\’ATION 

DATE 

A  i; 

WIS 

AP 

SEP  1900 

AP 

FEB  1987 

0515 

A1 

ACTIVE 

RT 

6200 

AP 

ACTIVE 

6186 

A1 

ACTIN’E 

6189 

A1 

DEC  1982 

GSM 

Of  If  in 

AP 

ACTIVE 

01)05' 

A1 

OCT  1963 

oinp 

A1 

APR  1986 

05l:I 

AP 

OCT  1980 

0511 

AP 

OCT  1980 

6515 

AP 

OCT  1980 

850-2 

AP 

JAN  1981 

8563 

A1 

OCT  1983 

8501 

A1 

OCT  1983 

8505 

A1 

OCT  1983 

IIT 

0100 

A1 

NO\'  1981 

01  in 

AI 

.MA5'  1987 

0120 

A1 

ACTIVE 

[ 

o:t;!:i 

AI 

NON'  1081 

0517 

Cl 

NOV  1981 

MS 

0125 

Cl 

NON'  1981 

RM 

01 M 

AI 

SEP  198-1 

6350 

AP 

OCT  1980 

63.52 

AP 

•M.AY  1984 

0380 

AI 

SEP  1984 

6381 

AI 

SEP  1981 

'I  N 

0057 

AI 

ACTIN'E 

\r  -  riiliMcd  ririi:ii  .11  oi  y  School 
A  I  -  Sliill  Irniiiing.  I'lilistiHl 

(  '1  -  Skill  I’rog,i(  ssion  Training.  Knlislrrl 

rniric:  Office  of  CNTT,  Mfiiiiiilns.  Tennessee 
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APPENDIX  E 

Cost  and  Setback  Data  by  Individual  Rating 


Hating  -  AE 

Fiacal  Year 

Average 

Annual 

locraaae 

(Decroaee) 

<») 

1986 

1987 

1988 

1989 

1990 

Piiad  Coat 
por  Graduate  ($) 

8836 

8339 

2213 

8002 

4161 

2.1 

Variable  Coat  par 
Graduate  (ti 

9626 

9266 

9796 

12085 

12974 

9  1 

Number  of  Oraduataa 

4265 

8066 

2883 

1389 

1496 

(16.2) 

Number  of  Attritee 

427 

442 

880 

869 

222 

(12.0) 

Graduate  to  Attrite 
Ratio 

10.0;1 

6.9:1 

D 

Qj 

m 

(8.3) 

Setback  Rate 

210 

22  0 

23.0 

47.0 

42.0 

6.2 

CDPe 

6218 

6236 

6615 

6218 

6616 

m 

6616 

6616 

Rating  •  BT 

Fiscal  Year 

_ 

Average 

Annual 

Increase 

(Decrease) 

(*) 

1986 

1987 

1968 

1989 

1990 

Fixed  Coat 
per  Graduate  ($) 

2900 

3340 

2767 

2662 

8136 

B 

Variable  Coat  per 
Graduate  ($) 

6669 

7663 

8962 

8937 

9973 

19.8 

Number  of  Graduates 

3173 

2346 

1986 

1642 

1029 

(16  9) 

Number  of  Attritee 

431 

223 

326 

342 

162 

(162) 

Graduate  to  Attrite 
Ratio 

7.4:1 

10.6  1 

6.1:1 

D 

D 

(2.0) 

Setback  Rate  («) 

la 

60.0 

43.6 

33.6 

17.6 

18.1 

CDPe 
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6486 
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1.] 
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Fixed  Coat 
per  Graduate  ($) 

941 
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4366 

4284 
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(0.8)* 

Variable  Coot  per 
Graduate  ($) 

1826 
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Number  of  Graduatoo 


Number  of  Attriteo 


Graduate  to  Attrite 
Ratio 


Setback  Rate  {%) 


CDPa 


614W  614W  614W  6: 
6UT  614T  614T  6 
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Rating  •  HT 

Fiaeal  Year 

1986 

1987 

1988 

1989 

1990 

Fixed  Coat 
per  Graduate  (|) 

3008 

1741 

2062 

1743 

1872 

VariaUe  Coot  per 
Graduate  (tl 

6741 

6679 

6899 

6078 

6714 

Number  of  Graduatee 

929 

1203 

912 

643 
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Number  of  Attritea 

64 

67 

68 

28 

79 

Graduate  to  Attrite 
Ratio 

14.6:1 

18.0:1 

16.7:1 

301:1 

12.7:1 

Setback  RaU  («) 

1.0 

mol 

IH 

CDPa 
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Average 
Annual 
Inereaae 
(Decree  oe) 
(%) 
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Rating  •  MS 
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VariaUa  Coat  par 
Graduate  ($) 


Numbar  of  Graduatea 


Numbar  of  Attritea 


Graduate  to  Attrite 
Ratio 


Satback  Rate  (%l 


CDPa 


1988 

1989 

972 

968 

2760 

3098 

3231 

3382 

314 

209 

10.3.1 

16.2:1 

23.0 

18.0 

6126 

6126 
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Annual 

Ineroaaa 

(Dacraaaa) 

(*) 


Rating  •  RM 


Piiad  Coat 
par  Graduate  (t) 


Variablo  Coat  par 
Graduate  (t) 


Numbar  of  Graduatea 


Numbar  of  Attritao 


Graduate  to  Attiite 
Ratio 


Satback  Rate  <«) 


CDPa 


flacal  Yaar 

Average 

Annual 

1986 

1987 

1988 
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(Dacraaaa) 

{») 

2403  2601  2722 


7042  747B  7269  7318 


1978  2106  2378 
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470  I  317 
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632 
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39  0  42  0  20  0  27.0 
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Ratiiig  •  YN 

Fiaeal  Year 

Average 

Annual 

Inereaac 

(Deeroaae) 

(») 

1M6 

1987 

1968 

1989 

1990 

Fixed  Cost 
per  Graduate  (t) 

1664 

1762 

1843 

1621 

1772 

1.3 

VariaUe  Coat  par 
Graduate  (t) 

3306 

6014 

6773 

4059 

4388 

6.2 

Number  of  Graduataa 

1142 

1489 

1432 

1148 

1193 

1.1 

Number  of  Attritao 

139 

213 

280 

132 

n 

(9.6) 

Graduate  to  Attrite 
Ratio 

8^:1 

mm 

Q 

13.9:1 

17.4 

Setback  Rate  (%) 

mm 

— 

B 

27.0 

16.0 

8.7 

CDPa 

6057 
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6067 

6067 

6067 
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